A Chain Rule for the Expected Suprema of Gaussian Processes
نویسنده
چکیده
The expected supremum of a Gaussian process indexed by the image of an index set under a function class is bounded in terms of separate properties of the index set and the function class. The bound is relevant to the estimation of nonlinear transformations or the analysis of learning algorithms whenever hypotheses are chosen from composite classes, as is the case for multi-layer models.
منابع مشابه
ADK Entropy and ADK Entropy Rate in Irreducible- Aperiodic Markov Chain and Gaussian Processes
In this paper, the two parameter ADK entropy, as a generalized of Re'nyi entropy, is considered and some properties of it, are investigated. We will see that the ADK entropy for continuous random variables is invariant under a location and is not invariant under a scale transformation of the random variable. Furthermore, the joint ADK entropy, conditional ADK entropy, and chain rule of this ent...
متن کاملSupremum Concentration Inequality and Modulus of Continuity for Sub-nth Chaos Processes
This article provides a detailed analysis of the behavior of suprema and moduli of continuity for a large class of random fields which generalize Gaussian processes, sub-Gaussian processes, and random fields that are in the nth chaos of a Wiener process. An upper bound of Dudley type on the tail of the random field’s supremum is derived using a generic chaining argument; it implies similar resu...
متن کاملOn the Suprema Distribution of Gaussian Processes with Stationary Increment and Drift
In this report we study the suprema distribution of a class of Gaussian processes having stationary increments and negative drift using key results from ~Txtrerne Value Theory. We focus on deriving an asymptotic upper bound to the tail of the suprema distribution of such processes. Our bound is valid for both discreteand continuous-time processes. VVe discuss the importance of the bound, its ap...
متن کاملV.N. Sudakov’s Work on Expected Suprema of Gaussian Processes
It is noted that the late Volodya N. Sudakov (1934–2016) first published a statement in 1973 and proof in 1976 that the expected supremum of a centered Gaussian process is bounded above by a constant times a metric entropy integral. In particular, the present author (R.M. Dudley) defined such an integral but did not state nor prove such a bound.
متن کاملThe Rate of Entropy for Gaussian Processes
In this paper, we show that in order to obtain the Tsallis entropy rate for stochastic processes, we can use the limit of conditional entropy, as it was done for the case of Shannon and Renyi entropy rates. Using that we can obtain Tsallis entropy rate for stationary Gaussian processes. Finally, we derive the relation between Renyi, Shannon and Tsallis entropy rates for stationary Gaussian proc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014